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A  STOCHASTIC  NETWORK  FORMULATION 
FOR  PERFORMANCE  ASSESSMENT 
AND  LIFE-CYCLE  MODELING 
IN  COMPLEX  SYSTEM  DESIGN 

By- 

Austin  J.  Lemoine 
Software  Technology  Department 


ABSTRACT 


'A  network  model  incorporating  various  stochastic  fea’ures  is  considered.  The  model  seeks 
to  represent  a  complex  sequential  process  wherein  an  object  or  '^ystem’^moves  through  a 
succession  of  states  (nodes)  and  operating  modes  (classes)  in  the  course  of  carrying  out  or 
fulfilling  its  function,  and  with  the  transitions  among  states  and  operating  modes  occurring 
in  a  possibly  random  manner,  and  requiring  (consuming)  some  resource  in  randomly  varying 
amounts. sModel  structure  is  reminiscent  of  the  BCMP  [I]  setup  for  an  open  network  jf 
queues  withjufficicnt  servers,  but  the  viewpoint  adcutied^h^re  is  motivated  by  our  project 
experience  and  also  by  Harrison  and  LemoineTSj?  Wtr  discuss  the  routing  behavior  and 
resource  requirements  of  typical  objects  moving  through  the  network,  the  evolution  of  the 
network  over  time  when  external  input  follows  a  possibly  nonhomogenous  Poisson  pattern, 
the  aistance’,oetween  the  time-dependent  distribution  of  state  and  the  limiting  distribution 
when  the  Poisson  input  is  homogenous,  and  some  potential  applications  of  the  formulation 
and  results. 
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SECTION  1 
INTRODUCTION 

Stochastic  networks,  or  vector  random  processes,  provide  an  appealing  framework  for 
modeling  complex  sequential  processes  evolving  under  uncertainty.  Stochastic  networks  find 
application  in  such  diverse  areas  as  queueing  systems,  computer  and  communication  net¬ 
works,  logistics/repair  systems,  manufacturing  processes,  inventory  systems,  and  population 
studies,  as  well  as  planning  and  management  of  research  and  development  projects.  (Cf.  Kelly 
[6],  Lemoine  [8],  [9],  and  Whitehouse  [12]). 

This  paper  discusses  a  simple  but  rather  flexible  network  model  that  incorporates  certain 
stochastic  effects.  We  consider  a  network  of  stations  or  processors  and  associated  functions, 
with  uncontrolled  input  of  objects  or  jobs  (requests  or  demands  for  execution  of  functions), 
random  movement  (routes)  of  objects  through  the  system,  randomly  varying  resource  require¬ 
ments  to  execute  the  functions,  and  time  horizons  of  shorter  duration  then  necessary  to 
achieve  steady-state  for  situations  where  it  might  be  important  to  respond  to  demands 
promptly  and  with  minimal  competition  for  available  resources.  The  model  structure  is 
reminiscent  of  Baskett  et  al  [1],  but  the  approach  taken  in  analyzing  the  model  is  prompted 
i  by  Harrison  and  Lemoine  [4]. 

This  paper  is  organized  as  follows.  Section  2  gives  the  basic  features  of  the  model.  Section 
3  considers  movement  of  a  typical  object  through  the  network,  with  particular  emphasis  on 
the  resources  required,  global  as  well  as  nodal,  to  process  the  object  until  it  leaves  the  system. 
Section  4  considers  the  evolution  of  the  network  over  time  when  the  pattern  of  demand  input 
*  is  a  Poisson  process  and  the  processing  capacity  available  at  each  node  in  the  network  is 
effectively  unlimited  (ie,  there  are  sufficient  servers  at  each  node  so  that  objects  never  wait 
in  queue).  An  explicit  representation  is  given  for  the  time-dependent  distribution  of  network 
state  (defined  here  as  the  number  of  objects  of  each  type  at  each  node  in  the  system).  When 
1  the  Poisson  input  process  is  homogenous,  this  time-dependent  distribution  converges  to  a 

limit,  and  the  ‘‘distance”  between  the  time-dependent  and  limiting  distributions  is  estimated. 
Section  5  describes  a  few  situations  where  the  model  formulation  and  results  may  be  appronri- 
j  ate. 

j  In  Sections  3  and  4  it  is  necessary  to  distinguish  between  moment  generating  functions  and 

;  Laplace  transforms.  In  particular,  let  X  be  a  nonnegative  random  variable,  6  a  real  parameter, 

,  and  4>(d)  m  E{exp  (tfX)}.  Then  4>(0)  exists  but  could  have  value  +  <*>  for  some  0>O.  If 

i  is  finite  for  some  0  >  0,  then  X  (more  properly,  the  distribution  of  X)  is  said  to  have  a 

j  moment  generating  function.  The  function  <£(•)  restricted  to  6  values  in  1-®,  01  is  of  course 

|  the  Laplace  transform  (of  the  distribution)  of  X. 

i  Acknowledgement.  A  preliminary  version  of  this  paper  in  outline  form,  coauthored  with  Dr. 

Lewis  Meier,  appeared  in  the  Proceedings  of  the  Third  International  Conference  on  Distribu¬ 
ted  Computer  Systems,  Miami,  Florida,  1 982.  The  conference  paper  was  oriented  to  a  specific 
application  area  in  distributed  systems  and  was  prepared  for  U.S.  Army  Contract  No. 
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DASG-60-78-L-0079  with  Systems  Control  Technology,  Inc.,  Palo  Alto,  California.  The 
present  paper  represents  a  substantial  generalisation  of  its  author's  contribution  to  the  confer¬ 
ence  paper.  We  are  very  grateful  to  Dr.  Lewis  Meier  for  illuminating  discussions  on  distrib¬ 
uted  computing  systems. 
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SECTION  2 

MODEL  DESCRIPTION 


Consider  a  network  (Figure  1)  in  which  objects  (jobs,  items,  messages,  etc)  in  different 
classes  (types,  operating  modes,  etc)  are  moving  through  the  system  and  also  changing  class, 
m  a  possibly  random  manner,  and  requires  a  randomly  varying  amount  of  resource  (service/ 
processing/ repair/ replacement,  eg,  capacity-machine  instructions  per  second,  words  of  mem- 
ory,  buffer  space,  time,  dollars,  equipment,  material,  manpower  and  skill  levels,  etc)  at  each 
node  visited.  TTiere  are  N  nodes  (stations,  service/processing/repair/supply  centers,  tasks, 
milestones,  etc)  indexed  by  i,  and  there  are  M  object  classes  indexed  by  m.  Inputs  (customers, 
demands,  requests)  at  any  node  may  originate  directly  from  outside  the  system  or  by  internal 
transfer  within  the  network.  On  any  visit  to  node  i  by  an  object  in  class  m  the  object  is  dropped 
from  the  network  (routed  to  sink)  after  processing  at  i  with  probability  qmi,  independently  of 
previous  visits,  classes,  and  other  objects  present  in  the  system.  In  this  event,  the  amount  of 
resource  required  at  node  i  to  process  the  object  is  distributed  as  a  random  variable  S^.  On 
any  visit  to  node  i  by  an  object  in  class  m  the  object  remains  in  the  system  after  processing 
at  node  i  and  transfers  to  node  j  as  an  object  in  class  r  with  probability  pZ  independently  of 
prior  visits,  classes,  and  other  objects  (if  i  =  j  then  the  object  is  sent  back  to  node  i),  where 

N  M 

Z  p"r 

rii  ««i  * 

for  each  m  and  i;  and,  in  this  event,  the  amount  of  resource  required  at  node  i  to  process  the 
object  is  distributed  as  a  random  variable  R“.  All  objects  eventually  exit  the  system. 

■Hie  preceding  formulation  easily  accomodates  multiple  resource  types  by  specifying,  for 
each  type  of  resource,  appropriate  probability  distributions  for  R~  and  S™.  Subsequent 
sections  of  this  paper  do  not  distinguish  between  multiple  resource  types,  but  the  results  of 
Section  3  are  valid  for  each  resource  type. 
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SECTION  3 

ROUTING  AND  RESOURCE  REQUIREMENTS 


Consider  now  the  route  of  a  generic  object  through  the  network.  Let  bmj  be  the  probability 
that  an  object  enters  the  system  through  node  s  in  class  m.  For  ij=l,„.,N  let  PtJ  =  [pjj]  where 
m,r«l,...,M  so  that  P^  is  an  M  by  M  matrix,  and  then  put  P  =  [P^}  so  that  P  is  an  N  by  N 
block  matrix.  The  routing-and-class  history  of  a  typical  object  moving  through  the  system 
corresponds  to  the  evolution  of  a  finite  absorbing  Markov  chain  with  a  single  absorbing  state 
(the  network  sink)  and  with  transitions  among  nonabsorbing  states  governed  by  P.  Let  1  be 
the  NM  by  NM  identify  matrix.  Since  all  objects  eventually  exit  the  system  the  matrix  I-P 
is  invertible,  and 

d_P)-i  =  f;  p* 

«-0 

If  we  put  (f  -  PV’  =  [AjJ  and  Ay  *  [a'j]  then  is  the  expected  number  of  requests  for 
processing  at  node  j  by  an  object  in  class  r  that  originally  enters  the  network  through  node 
i  in  class  m.  Let  py'bc  the  probability  an  object  entering  via  node  i  in  class  m  reaches  node 
j  in  class  r  at  some  later  step.  Then  £,"=  1  -  (i*)'1  and  pTt'~  ay'/ ay  otherwise.  Moreover,  if  qy' 
is  the  probability  that  an  object  entering  the  network  via  node  i  in  class  m  exits  the  system 
from  node  j  in  class  r,  then  qjj  =  and  q’y  *  py  qy  otherwise.  Finally,  if  q™  is  the 
unconditional  probability  that  an  object  exits  the  system  from  node  i  in  class  m  then 

The  above  expressions  for  the  probabilities  py,  q~'  and  qj*  follow  immediately  from  well 
known  results  for  finite  absorbing  Markov  chains;  cf.  Kemeny  and  Snell  (7). 

Observe  that  the  crucial  factor  in  determining  these  various  routing  and  class  parameters 
is  computation  of  the  matrix  (I  -  P)'1.  In  many  applications  of  interest  this  matrix  I  -  P  will 
be  relatively  sparse,  indeed  even  upper  triangular. 

Turning  to  global  network  resource  requirements,  let  Lmi  be  the  total  level  of  resources 
necessary  to  process  an  object  until  it  reaches  the  network  sink,  given  that  the  object  enters 
the  system  at  node  i  in  class  m.  For  $  <  0  let  gm{6),  and  1^(0)  be  the  Laplace 

transforms  for  the  distributions  of  S^,  Rj^  and  L*»,  respectively.  By  virtue  of  the  independence 
assumptions  regarding  routing  and  class  and  resource  requirements  on  visits  to  nodes,  the 
transforms  {L^ffl):  m  =  1 . M.  and  i  =  1,...,N]  satisfy  the  network  flow  equations 

H  M 

»•«.»» -w-iwi+e  e  «» r&rw*Vif*H 

j*i  i“i 
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These  network  flow  equations  have  a  unique  solution:  Let  f(0)  and  h(0)  be  MN  column 
vectors  consisting  of  N  biocks  of  length  M  where  entry  m  of  block  i  in  f(9)  is  and 

entry  r  of  btock  j  in  h{£)  is  1^(0).  Let  D(0)  be  an  N  by  N  block  matrix  where  the  (ij)th  block, 
say  Dj*(0),  :r  the  M  by  M  matrix  {p,  £j{0)].  Then  equation  (1)  is  equivalent  to 

h(»)  -  ftf)  +  DffflhfSl  t2> 

or 

II  -  D<tfl]  h (6)  -  f(0) 


Since  0  $  D(<?)  <  P  componentwise,  it  follows  that  the  matrix  [I  -  D(0)J  is  invertible  for  all 
9  <  0;  indeed 

u-Dwr’-f;  icxeij* 

x-O 


Thus 


Computation  of  the  transforms  {h^iO?)}  from  (3)  is  not  entirely  straightforward,  but  we 
will  provide  an  explicit  representation  for  those'transforms  using  a  slightly  different  approach. 

Repeated  differentiation  of  the  network  flow  equations  with  respect  to  9  provides  a  recur¬ 
sive  procedure  for  computing  the  moments  of  the  cumulative  resource  variables  {  L^  }•  Let 
h,w*  =  E  {{Lmi)n},  gijn  =  E{(K*)*}  and  f,**,  *  E  {(Sh»)"}.  We  first  observe  that  if  the  variables 
Rfq  }  have  finite  moments  of  order  n  then  the  variables  fL^}  also  have  this  property. 
Differentiating  both  sides  of  (2)  n  times  with  respect  to  9  and  using  Leibnitz's  Rule  leads  to 

hw («)*  1^(8)  +  2 
x-t' 


or 

hw(«>« U-D(0>]~1[fWf0>  +  £  IJlD^Wlh^W)]  (♦) 

x-1 


where  the  superscripts  correspond  to  componentwise  differentiation  in  (2).  Suppose  that 
Lm,}"'1  has  a  finite  mean  (this  certainly  holds  for  n  =  1).  Then  each  component  of  b‘r:  ’)  (6) 
has  a  finite  limit  as  0  -►  0  for  x*l,...,n.  Since  {I  -  Dffl)]'1  -►  [I  -  PJ'1  as  9-*-  0,  it  follows  from 
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(4)  that  each  component  of  h<n)  (0)  has  a  finite  limit  as  8  -*  0,  and  so  (L^)"  has  finite  mean. 
Thus  by  mathematical  induction  has  a  finite  moment  of  order  n.  Moreover,  (4)  yields  a 
compact  recursive  formula  for  computing  these  moments.  Let  6„  h„,  and  ho  be  NM  column 
vectors  where  the  entries  corresponding  to  (m,i)  are  q^jV,,.  h***,  and  1.  respectively  Also, 
let  Dx  be  an  NM  by  NM  matrix  where  the  entry  corresponding  to  (m.i).  {rj)  is  Then 

K~u~rv'[&n*£i*K)Dx^K]  (5) 

*•1 


Recursion  relation  (5)  requires  only  the  given  network  parameters  (ie.  the  matrix  P,  the 
moments  of  the  variables  {R^  and  computation  of  the  matrix  (I  -  P)  \ 

Consider  now  local  resource  requirements.  Let  be  the  resources  required  at  node  j  to 
process  an  object  in  class  r  that  enters  the  network  at  node  i  in  class  m.  l*j  is  the  total  loading 
induced  at  node  j  by  an  object  in  class  r  entering  at  node  i  in  class  m.  Observe  that 


N  M 

Lbi*££  l% 
r»  *-i 


Let  be  the  Laplace  transform  of  For  an  arbitrary  node  k  and  object  class  s  let 

+  u»k  *  1  *  ft*  and 


**<8) 


18)  ♦  u  10) 

1 


16) 


The  quantity  u*t  is  the  probability  that  an  object  at  node  k  in  class  s  departs  the  network  either 
without  returning  to  node  k  or  from  node  k  but  in  a  different  class.  We  then  have 

/*~ii8)  if  •  *  j  and  m  •  r,  and 

♦pc*) -I  ro 

ll  -  pS*  +  p*r  f'-iO)  otherwise 

Moreover,  in  reference  to  the  comment  following  (3)  above, 

M  M 

hwj{8)-  n  n  ♦pie)  (8) 

H  »*1 

Next,  we  observe  that,  if  the  resource  variables  {  S**,  {  have  moment  generating 

functions,  then  so  do  the  cumulative  resource  variables  {!_,*}.  In  particular,  suppose  the 
transforms  J  f— (8),  gj(8)}  converge  for  all  8-values  in  the  interval  (-®,8t)  where  0t  >  0.  Select 
a  node  k  ami  object  class  s.  Since  <  1  there  is  a  80  in  (0,8,)  for  which  p&  gJS,  (80)  <  1. 
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If  t  >  0  then 


Elexplminl^L&.tH  }  -  q*  E{*xp{min  (0O  L*  ,t)}  |  +  u^Ejexpfmml^R^.t)} 

+  pg,.  Elwtptminl^Bj^  +  S0Lg,,t)J } 

where  is  independent  of  R|J,  and  distributed  as  Ljj*.  Noting  that  min  (a+b„c)  <  min  (a,c) 
+  min  (b,c)  when  a,  b,  and  c  are  nonnegative,  it  then  follows  that 


EjaxpUnwR^L^.O)}  < 


Letting  t  -*■«>.  we  see  that  <Ptk(^o)  is  finite  and  that  (6)  is  valid  for  8  ^  80.  Thus  ( 1 ),  (6),  (7). 
and  (8)  are  also  valid  for  all  0- values  in  some  interval  {  -  «e,  02)  where  92  >  0. 

Finally,  let  L^,  be  the  total  resources  required  at  node  i  in  class  m  by  a  typical  job  entering 
the  network.  Then  LJ^  has  Laplace  transform  for  moment  generating  function). 

t  £  «*r«  . 

j-i  i-i 
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SECTION  4 
POISSON  INPUT 


Consider  now  the  evolution  of  the  network  over  rime  when  objects  enter  the  system 
according  to  a  Poisson  process  A  =  {A(t),  t  >  0}  with  intensity  function  (X(t),  t  3=  0}  and  the 
processing  capacity  available  to  each  node  in  the  network  is  unlimited.  The  variables  R*and 
Smj  are  then  interpreted  as  service  or  processing  times  at  node  i.  The  discussion  we  give  follows 
Section  3  in  Harrison  and  Lemoine  {4], 

The  assumption  of  Poisson  input  as  stated  above  means  that  the  numbers  of  objects 
arriving  in  nonoverlapping  time  intervals  are  independent  random  variables  „nd  that 


where 


p{  Aft)  ■  n}  -e~AW 

ni 


Aft)  *  /  XfvMy 


In  particular,  if  A^ift)  is  the  number  of  objects  entering  the  network  through  node  i  in  class 
m  up  to  time  t  and  Ami  =  {Amj{t),  t  3  0},  then  Ami  are  independent  Poisson  processes  and  Ami 
has  intensity  function  {bmi  X(t),  l  3s  0}. 

The  histories  of  objects  moving  through  the  system  are  independent  and  distributed  as  a 
process  Y  =  (Y(t),  0  <  t  <  L}  where  L  is  the  total  length  of  time  a  generic  object  is  in  the 
network.  In  particular,  with  probability  bmj,  Y(0)  =  (m,i)  and  L  has  the  same  distribution 
as  the  variable  Lm,.  Now  define 

N  M 

=  P  { L  >  t,  Y(t)  “  (r,j)}=  £  £  bmiP{Lmi>t,Y(t)-{r.j)lY(0)-(m,i)} 
i  »1  m-t 

£rj  (t)  m  /  X(y)7rj(v-y)dy, 


N  M  t 

f't)3  £  £  £rf(t)  -  /  X(y)P{L>t-y}dy 
J"1  r*1  o 

Assuming  the  network  is  empty  at  time  0,  the  quantity  £rj(t)  is  the  expected  number  of  objects 
in  class  r  occupying  node  j  at  time  t,  £(t)  is  the  expected  number  of  objects  in  the  system,  and 
A(t)  -  <(t)  is  the  expected  number  of  objects  that  have  arrived  and  departed  from  the  system 
by  time  t. 
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Now  let  C,j(t)  be  the  number  of  objects  in  class  r  occupying  node  j  at  time  t,  and  let 


C(t)  *  { C,j  (t),  r  =  1 . .  M  and  j  =  1, . N } 

be  the  state  of  the  network  at  time  t  where  C  *  tcn}  is  a  generic  state.  Then  the  following 
remarkable  result  holds  (cf  [4]); 

N  M 

P  { C  U) '  C }  =  8-^ (t}  n  n  [y til  ^/{c^n  (91 

ri  i*t 

That  is,  the  number  of  objects  in  class  r  occupying  node  j  at  time  t  has  a  Poisson  distribution 
with  mean  |ri(t),  and  the  numbers  occupying  the  various  nodes  and  classes  are  independent 
random  variables.  Moreover,  the  total  number  of  departures  from  the  system  by  time  t  has 
a  Poisson  distribution  with  mean  A(t)  -  |(t). 

Implementation  of  (9)  requires  computation  of  the  mean  values  which  is  difficult 

for  nonhomogenous  input.  Suppose,  however,  that  A  is  a  homogenous  Poisson  process  with 
X(t)  <•  X  for  t  ^  0.  Let 


AdM*-  E  bmiE{Lr} 


M  m“1 


N  M 

EE s<j 

j-1  r»l 

Iu  the  homogenous  case  we  have  £n(t)  f  £fj  as  tf00-  It  then  follows  from  (9)  that 


l«m  P  {C (t>  -  C}  -  e-t  £  E  «*>  <10> 

j*1  r»1 

This  limiting  or  asymptotic  distribution  depends  only  on  the  arrival  rate  X  and  the  expected 
amount  of  time  £ri  that  an  object  spends  at  node  j  in  class  r  while  in  the  network,  and  not  upon 
the  forms  of  the  distributions  for  service  times  at  the  various  nodes.  Moreover  the  numbers 
of  objects  occupying  the  various  nodes  and  classes  are  independent,  Poisson  distributed, 
random  variables.  For  the  case  of  homogenous  input,  the  process  of  departures  from  the 
system  is  Poisson  with  intensity  function  jXH(t),  t  >  0)}  where  H(t)  =  P{L  <  t).  Thus,  as 
tt«,  the  process  of  departures  is  asymptotically  Poisson  with  rate  X.  Indeed,  the  process  of 
departures  from  node  j  by  objects  in  class  r  is  asymptotically  Poisson  with  rate  XqJ),  and  these 
node/class  departure  processes  are  asymptotically  independent  across  the  various  nodes  and 
classes;  cf  Kelly  [6]. 


WDL-TR9854 


Ford  Aerospace  A 
Communication*  Corporation 


-  **j _ 


V  I 


In  the  case  of  homogenous  input,  the  time-dependent  distribution  of  state  given  by  (9)  can 
be  approximated  by  the  asymptotic  distribution  given  in  (10)  when  t  is  large  enough.  The 
closeness  of  this  approximation  can  be  gauged  as  follows:  Let  x,(C)  denote  the  right  side  of 
(9)  and  x(C)  the  right  side  of  (10)  and 

£  brt{C)-x(C)l 
C 

We  can  think  of  d(xt,x)  as  the  distance  between  the  distribution  of  state  at  time  t,  namely 
xt,  and  the  asymptotic  distribution  of  state  x.  (In  measure  theory,  d(x,,  x)  is  the  total  variation 
of  the  signed  measure  x  -  xt.)  For  the  multidimensional  Poisson  distributions  x,  and  x  (cf 
Cinlar  [3],  pp.  564-565) 

N  M 

d(*t.*)<2  £  £  Urf-triWi 

rt  i»t 

But  the  summation  on  the  right  side  of  this  inequality  is 

OC t 

|-|(t )  -  X  /  P{L>y}dy 

t 

Assume  henceforth  that  the  resource  variables  {Smi,  $[}  have  moment  generating  func¬ 
tions.  This  is  not  a  severe  restriction  as  the  distributions  customarily  used  in  the  modeling  of 
service  systems  and  queueing  networks  have  this  property.  Take  8  >  0  for  which  jhmi(0)}  are 
finite.  Put  4>(8)  *  E  (exp(0L)},  where,  of  course, 

N  M 

m  -  £  £  b,iW0> 

rl  r-1 

Now  P{L  >  y}  —  PJexp  (0L)  >  exp  (0y)}  and  by  Chebyshev’s  Inequality  (cf  Chung  [2],  p.  48), 
P{  exp(flL)  >  exp(0y)}  ^  4>{8)  exp(-0y). 

Hence 

Jp{L>y}dy<^.-«t 

Thus,  if 

then 
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S-M< tK{(t)<i 


(11) 


and 


d(x,,x)  <  2u(t) 


Similar  results  hold  for  the  marginal  distributions  of  xt  and  x.  Indeed,  if  B  is  a  subset  of 
{(r  j)  },  and  xBt  and  xB  are  the  corresponding  marginal  distributions  of  x,  and  x. 


and 


d(xB«,x8)<2fiB(t) 


(12) 


where 

MB<t) 

B 

Moreover,  if  X  has  a  Poisson  distribution  with  mean  0  (cf  Hoel  et  al  [5],p.  107 ) 

p{x<^/2}<(N/27S»0 

and 

pjx  >  2$J  <  (a/4)^ 

Let 

“bW-L* ^  -  Me  (t) 

8 

Then 

P(crj(t)  <  {„{t)/2  for  ail  (r.j)  in  B)=n  P(c.(t)  <  *„<!>/*}  <  n  {y/zfefr  ^ <  <v'27a)“B  ^  (13) 

B  B 

and 

P{c,j  (t)  >  2^ (t>  for  ail  (rj)  in  b}  <  (aMp  Bw  (14) 
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Finally,  if  V' 
and  (14), 


and 


*  [C^i  is  a  random  vector  having  distribution  r,  then  letting  t  -►  ®  in  (13) 


P  { Cjj  <  J^/2  for  >11  (rj) }  <  h/2/S)* 

(IS) 

P  {C^  >  2t  ^  for  all  (r  j) }  <  («/4)t 

(16) 

Ford  Aoroopoc*  A 
CotnmunicaaoM  Corporation 


WDL-TA9BS4 


4-5 


SECTION  5 

MODEL  DISCUSSION 


This  section  discusses  briefly  a  few  situations  where  the  model  considered  in  this  paper  may 
be  relevant. 

The  informative  book  of  Whitehouse  [12]  provides  an  extensive  discussion  in  Chapters  8 
through  11  of  a  methodology  called  GERT  (Graphical  Evaluation  and  Review  Technique). 
GERT  combines  flowgraph  theory,  transform  theory,  and  PERT  (Program  Evaluation  and 
Review  Technique)  to  obtain  solutions  to  stochastic  problems  from  a  network  oriented  point 
of  view.  A  large,  varied,  and  impressive  array  of  applications,  theoretical  and  applied,  of  the 
GERT  approach  to  problem  solving  is  presented  in  Chapters  8,  10,  and  11  of  [12].  Topics 
include  derivation  of  first-passage  distributions,  queueing  systems,  repairman  problems  and 
reliability  systems,  manufacturing  processes,  inventory  systems,  quality  control  sampling 
plans,  planning  and  management  of  research  and  development  programs,  gaming,  traffic 
problems,  and  more. 

Typical  output  of  the  GERT  solution  procedure  includes  probability  of  traversal  of  a 
network  path  or  loop,  mean  time  of  traversal  of  a  path  or  loop,  and  second  moment  of  the 
traversal  time.  Implementation  of  the  GERT  procedure  as  presented  in  [12]  requires  an 
appropriate  network  formulation  followed  by  application  of  Mason’s  Rule,  a  result  from 
flowgraph  theory. 

The  model  considered  in  this  paper  is  sufficiently  general  to  accommodate  the  plethora  of 
stochastic  network  applications  and  scenarios  presented  in  [12];  indeed,  the  model  structure 
offers  enhanced  flexibility  in  problem  formulation  and  solution.  The  results  given  in  Section 
3  should  be  simpler  to  compute  with  than  the  “pictorial  flowgraph  technique"  based  on 
Mason's  Rule.  In  fact,  a  broader  and  richer  range  of  results  should  be  computationally 
tractable  using  tbe  methodology  presented  in  this  paper. 

The  formulation  of  Section  2  is  a  plausible  model  for  a  complex  sequential  process  wherein 
an  object  or  “system"  moves  through  a  succession  of  states  (nodes)  and  operating  modes 
(classes)  in  the  course  of  carrying  out  or  fulfilling  its  function,  with  the  transitions  among 
states  and  operating  modes  occurring  in  a  possibly  random  manner,  and  requiring  (consum¬ 
ing)  some  resource  in  randomly  varying  amounts. 

Consider  a  job  (message)  moving  through  a  computer  (communication)  system.  Perform¬ 
ing  the  job  entails  execution  of  software  modules  embedded  in  a  network  of  processors.  The 
job,  depending  on  its  type,  may  require  execution  of  a  particular  set  of  software  modules  with 
attendant  variation  in  the  machine  instructions  per  second  (or  words  of  memory)  required  at 
processing  centers.  Sending  a  message  or  data  packet  entails  routing  through  a  network  of 
transmitting  stations.  The  message,  depending  on  its  type  (priority),  may  require  routing 
along  a  particular  path  with  attendant  variation  in  buffer  space  and  frames  required  for 
transmission  through  each  station  along  the  path.  A  system  in  the  course  of  its  life  cycle  moves 
through  stages  of  availability  (mission  readiness)  and  unavailability  (failure,  repair,  mainte- 
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nance).  The  system  may  be  fully  operational  or  degraded,  component  failures  may  have 
varying  impact,  repair  or  maintenance  may  restore  the  system  to  some  previous  level  of 
readiness  or  be  faulty  and  inadequate  and  possibly  damaging  to  the  system.  Maintenance  and 
repair  may  require  varying  skill  levels,  support  equipment,  and  replacement  of  defective 
components  {spares  provisioning).  Built-in  test  equipment  or  alarm  mechanisms  may  trigger 
system  shutdown  based  on  erroneous  signals,  or  fail  to  monitor  a  deteriorating  situation  and 
issue  appropriate  warnings  or  shutdown  commands. 

The  model  formulation  is  sufficiently  general  to  capture,  albeit  imperfectly,  the  important 
factors  and  interactions  in  these  examples.  Performing  the  job,  moving  the  message,  or 
supporting  the  system  through  its  life  cycle  induce  loads  or  resource  requirements  at  each  step 
or  stage  along  the  way,  and  the  results  of  Section  3  assess  the  extent  of  these  resource 
requirements  at  the  nodal  and  global  levels. 

The  transforms  of  some  important  distributions  in  models  for  networks  of  queues  satisfy 
the  network  flow  equations  (1 ).  For  open  BCMP  [  1  ]  networks,  the  transform  (of  the  distribu¬ 
tion)  for  the  total  service  time  of  a  job  entering  the  system  through  node  t  in  class  m  satisfies 
(1).  In  that  case,  the  distributions  of  and  R^are  identical  and  depend  only  on  i.  Moreover, 
if  the  routing  structure  is  acyclic  and  every  two  nodes  are  connected  by  at  most  one  directed 
path,  the  transform  of  the  steady-state  total  sojourn  time  (response  time)  distribution  for  a 
job  entering  through  node  i  in  class  m  satisfies  (l);cf  Walrand  and  Varaiya  [11]  and  Lemoine 
[10].  The  recursive  formula  (5)  then  provides  a  compact  scheme  for  computing  moments  of 
these  disv  tutions. 

Section  4  provides  a  fairly  complete  picture  of  the  behavior  of  a  system  of  infinite-server 
queues  with  Poisson  input  where  the  history  of  a  typical  individual  or  object  moving  through 
the  network  is  as  described  in  Section  2.  In  this  setting,  time  is  the  resource  required.  The 
overall  simplicity  of  the  results  in  Section  4  can  be  traced  to  the  order-statistic  property  of 
the  Poisson  process  and  the  fact  that  objects  do  not  compete  with  one  another  when  sufficient 
service  capacity  is  always  available. 

Viewed  from  a  performance  standpoint,  infinite-server  systems  represent  an  upper  bound 
on  performance  potential  since  measures  such  as  response  (sojourn)  time  or  system  through¬ 
put  depend  only  upon  routing,  service  times,  and  input  rates.  However,  results  for  such 
systems  are  of  interest  for  design  and  performance  prediction. 

The  upper  and  lower  conf  dcncc  levels  given  in  ( 1 5 )  and  ( 16 )  indicate  the  extent  to  which 
the  network  population  will  remain  within  certain  bounds,  and  hence  provide  a  means  of 
assessing  the  adequacy  of  alternate  system  designs,  which,  of  course,  will  have  finite  capacity. 
Indeed,  in  systems  which  must  gather  and  process  a  huge  amount  of  data  in  real  time  and 
at  phenomenally  high  rates,  it  is  important  to  assess  at  the  design  stage  the  adequacy  of  the 
proposed  processing  resources  to  handle  the  anticipated  workloads.  Moreover,  the  formula¬ 
tion  presented  here  provides  additional  flexibility  in  modeling  diverse  phenomena,  and  the 
relative  simplicity  of  the  results  facilitates  computation  in  studying  alternative  possibilities 
and  configurations. 
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Finally,  consider  a  logistics-repair  system  comprising  many  units  of  diverse  types  and  a 
variety  of  support  functions  (maintenance,  repair,  replenishment,  etc).  Suppose  the  process 
that  records  the  initial  failures  or  epochs  of  unavailability  of  units  (measured  from  when  they 
arc  put  into  operation  for  the  first  time)  is  Poisson.  In  view  of  the  comments  above  regarding 
life  cycle  modeling  of  an  individual  unit,  the  results  of  Section  4  provide  a  relatively  simple 
means  of  approximating  the  status  of  the  overall  system  as  it  evolves  through  time,  while 
accounting  for  any  number  of  important  factors  and  considerations,  and  of  assessing  the 
adequacy  of  various  support  resources  in  relation  to  mission  requirements  and  operational 
availability. 


Ford  Atrotpte*  A 
CommuntcaMowe  Corporation 


WDL -Tn&954/TR8SS5 


5-3 


REFERENCES 


[1]  Baskett,  F.,  Chandy,  K.M.,  Muntz,  R.R.,  and  Palacios,  F.G.  “Open,  Closed  and  Mixed 
Networks  of  Queues  with  Different  Classes  of  Customers,  Journal  of  the  Association  for 
Computing  Machinery  22,  pp.  248-260,  1975. 

[2]  Chung,  K.L.,  A  Course  in  Probability  Theory,  2nd  Ed.,  Academic  Press,  New  York,  1974. 

[3]  Cinlar,  E.,  “Superposition  of  Point  Processes,"  Stochastic  Point  Processes:  Statistical 
Analysis,  Theory,  and  Applications,  pp.  549-606,  P.A.W.  Lewis,  Editor,  Wiley,  New  York, 
1981. 

[4]  Harrison,  J.M.  and  Letnoine,  AJ„  “A  Note  on  Networks  of  Infinite-Server  Queues," 
Journal  of  Applied  Probability  18.  pp.  561-567,  1981. 

[5]  Hoel,  P.G.,  Port,  S.C.,  and  Stone,  C.J.,  Introduction  to  Probability  Theory,  Houghton 
Miffin,  Boston,  1971. 

[6]  Kelly,  F.P.,  Reversibility  and  Stochastic  Networks.  Wiley,  New  York. 

[7]  Kemeny,  J.G.  and  Snell,  J.L.,  Finite  Markov  Chains.  Van  Nostrand,  Princeton,  New 
Jersey,  1960. 

[8]  Lemoine,  AJ.,  “Networks  of  Queues  -  A  Survey  of  Equilibrium  Analysis,"  Management 
Science  24,  pp.  464-481,  1977. 

[9]  Lemoine,  A.J.,  “Networks  of  Queues  -  A  Survey  of  Weak  Convergence  Results,"  Manage¬ 
ment  Science  24.  pp.  1 1 75- 1 1 93,  1978. 

[10]  Lemoine,  A.J.,  “Total  Sojourn  Time  in  Networks  of  Queues,"  Tech  Rep.  No.  79-020-1, 
System  Control,  Inc.,  Palo  Alto,  CA,  1979. 

[11]  Walrand,  J.,  and  Varaiya,  P.,  “Sojourn  Times  and  the  Overtaking  Condition  in  Jackson¬ 
ian  Networks,”  Advances  in  Applied  Probability  12,  pp.  1000-1018,  1980. 

[12]  Whitchouse,  G.E.,  Systems  Analysis  and  Design  Using  Network  Techniques,  Prentice- 
Hall,  Englewood  Cliffs,  NJ,  1973. 


Ford  Aoroopoeo  ft 
CommuNcattorw  Corporation 


WDt-TR9954/Tre»6£ 


Oof- 1 


